


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1964 


Investigation of the statistical decisions 
orocess for anti-submarine warfare tactical decisions. 


Deffenbaugh, Robert M. 


http://ndl.handle.net/10945/12480 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 
| (8 D U DLEY research materials and institutional publications created by the NPS community. 
«ist sia Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


NY KNOX appointed — and published -- scholarly author. 

ia) LIBRARY Dudley Knox Library / Naval Postgraduate School 

411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 


NPS ARCHIVE 





1964 
DEFFENBAUGH, R. 


INVESTIGATION OF THE $ see iSTILAL peonatee, 
PROCESS FOR ANTI-SUSMARINE WARKF 
TACTICAL DECISIONS 


ROBERT M. DEFFENBAUGH 


wteae ae Ore 


til | | il Nt 








DUDLEY KNOX LIBRARY 
NAVAL POSTGRADUATE SCHOOL 
MONTEREY C4 92703-8101 
LIBRARY 
Us, NAVAL POSTGRACUATE SCHCCI 
MONTEREY, CALIFORNIA 




















INVESTIGATION OF THE STATISTICAL DECISION PROCESS 
FOR ANTU-SUBMARINE WARFARE 


TACTICAL DECISIONS 


by 


Robert M. Deffenbaugh 
/ 


Commander, United States Navy 


Submitted in partial fulfillment of 
the requirements for the degree of 


MASTER OF SCIENCE 
IN 
OPERATIONS RESEARCH 


United States Naval Postgraduate School 
Monterey, California 


1964 





: EiaRARY 
O03. NAVAL POSTGRADUATE SCHOAL 
MONTEREY, CALIFORNIA 


INVESTIGATION OF THE STATISTICAL DOFCES TION PROCESS 
FOR ANTI-SUBMARINE WARKFARE 


TACTICAL DECISTONS 


wk ewe KR 


Robert M. Deffenbaugh 





INVESTIGATION OF THE STATISTICAL DFCISTON PROCESS 
FOR ANTI-SUBMARENE WARFARE 
TACTICAL DECLSIONS 
by 


Robert M. Deffenbaugh 


This work is accepted as fulfilling 
the thesis requirements for the degree of 
MASTER OF SCYENCE 
IN 
OPERATIONS RESEARCH 
from the 


United States Naval Postgraduate School 





ABSTRACT 

The past few years have brought an increased interest im the scren- 
tific approach to decision-making. Current Literature senerally concerns 
itself with analytical theortes. 

This paper investigates an application of the statistical decision 
process to the problem of ASW tactical decisions. Tne Bayesian decision 
process is utilized. 

The paper analyzes the basic ASW decision problem with emphasis on 


the uncertainty aspect of a possible submarine contact. <A mechenism is 


developed to formally connect the general problem areas. 
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lL. [ntroduction. 

A large amount of literature is presently available on the theory 
of decision-making, and investigation of the subject continues, Comten- 
porary interest in the analysis of the decision-making process is gener- 
ally attributed to the published work of von Neumann and “Morgenstern. [12] 
The majority of the literature concerns itself with analytical theories 
of the process. A few writers have attempted to apply the theory to 
specific real world decision problems. (6, 7] 

One of the purposes of postgraduate education at the U. S. Naval 
Postgraduate School is to provide the student with sufficient scientific 
and technical background to permit him to fill the middle-ground between 
the scientist and the naval officer -- to provide the capability of in- 
terpreting present technical theory and development with an eye toward 
its application to naval warfare. This paper is an exercise in such 
interpretation. [It is an investigation of the current literature on the 
decision-making process with a specific application ts the decision prob- 
lems of an anti-submarine warfare commander. 

This paper attempts to analyze the ASW commander's tactical deci- 
sion problems. The objective of the commander's analysis is to select a 
particular course of action, from among the available courses of action, 
that is consistent with the commander's desire for a particular result. 

The heart of the problem is the uncertainty associated with a "pos- 
sible submarine contact"; an indication from one or more detection sensors 
that a submarine is present. [Is it &@ submarine or isn't it? 

This uncertainty is currently being evaluated by the comnander and 


his staff on the basis of experience and a particular “feel for the ASW 
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tactical situation, The purpose of the analysis in this poper 25 to pro- 
vide a formalism for taking into account the commander's preferences and 
the degree of contact uncertainty, rather than leavimg it to the deci- 
Sion-maker's unaided "feel" for the problem. 

An effort has been made to avoid the extreme techmical terminology 
and mathematical theory prevalent in much of the academic and theoreti- 
cal expositions of the subject. An attempt is made to confime the dis- 
cussion of theory to relevant areas of interest to the military reader. 
Although an ASW Hunter-Killer Group situation is used as an illustrative 
vehicle in investigating the decision problem, the analysis is equally 
applicable to maritime patrol aircraft and surface escort operations, 

This paper is an analysis of the basic decision problem with empha- 
sis om the uncertainty aspect of a possible submarine contact. A mecha- 


nism is developed to formally connect the general aspects of the problem. 


The Bavesian decision approach is utilized. 
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Tie generation of @& possible submarine contlt 
warfare operations will pose various decision requirements for am 45 
commander, among the decistons to be made are, whether or mot to prose- 
cute the contact, whether or not to provide additional forces, and 
whether or not to expend weapons, 

Enherent in the criteria for these decisions is the weight the 
decision-maker places eon the consequences of L) classifying a non-sub- 
marine contact as submarine, 2) classifying a submarine comtact as nomn- 
submarine, 3) classifying a non-submarine contact as non-submarine, and 
4) chassifying a submarine contact as submarine. The consequences of 
each alternative classification will vary with the particular tactical 
situation. For instance, classifying a valid submarine contact as non- 


submarine when defending a continent against missile launching submarines 


& 
would be much more critical than making the same classification in a 
force-support situation with the contact fifteen miles astern of a fast 
moving carrier task force. 

Inputs for these decisions include forces and weapons available, 
the number of contacts currently being prosecuted, and the prospects of 
additional valid contacts. 

The solutions cto these decision problems are typically based on 
the "feel" that a commander and his staff have for the anti-submarine 
warfare problem. This "feel" is primarily the result of past experience. 
The increasing distance in time since World War LI, coupled with the 
increased complexity and sophistication of airborne, surface, and sub- 


surface ASW equipments dictates that this experience be gained during 








peacetime training exercises. 

The inborn artificialities of exercise situations tend to obscure 
many of the crucial inputs that must necessarily be considered in a war- 
time situation. As an example, training exercises span a specified time 
period, typically 72 to 96 hours. The number of opposing submarines is 
generally known. Weapons are simulated by sound charges that can be 
carried in large numbers. These artificialities have, in past exercises, 
led to decisions to commit forces at a rate that would make them ineffec- 
tive after 96 hours of operation. The exercise tactic of attacking 
every contact with a = imeeee weapon is not compatible with the number 
of actual weapons available, nor with the load capability of the delivery 
vehicle. In addition, the generation of simultaneous contacts im excess 
of the number of target submarines known to be assigned to the exercise, 
results in some contacts being suspect on a purely numerical basis. 

These factors bias tactical decisions and would not be present during 
wartime operations. 

The effects of these exercise artificilalities can be reduced or 
eliminated by realistic exercise limitations. However, tos stringent 
limitations as to assignment of forces and expenditure of simulated 
weapons reduces the training and experience availabie to individual 
units participating in the limited exercise periods. 

The critical parameter in the ASW commander's decision problems is 
the uncertainty associated with a given contact. Statistical data from 
exercises where valid reconstruction has been possible points up the 


degree of uncertainty associated with every contact. The effect of this 


uncertainty during exercise situations is somewhat obscured during the 
y ; 8 
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exercise by the desire to work individual ASW units im every possible 
contact area. This is a spurious input factor to the required experience 
and "feel" of the decision maker. 


V 


The objective of any amalysis of the ASW commander's decision prob- 
lem is to identify a course of action that is logically consistent with 
the degree of contact uncertainty and the comsequences associated with 
each available course of action, The analysis cam reasonably be divided 
into two areas for discussion. The first area is that of contact uncer- 
tainty. The second area considers the consequences of each course of 
action. 

Contact uncertainty, in the parlance of the statistician, is uncer- 
tainty due to the state of nature. A given contact is either 4a submarine 
or it is not. Here the two states of naturé are submarine, or non-sub- 
marine. 

The consequences cf various courses of action can be analyzed by 
subjectively associating 4 value judgement or utility with each action. 


A given action will produce a desirability of result for each possibie 


state of nature. This is more nearly a problem in prediction. 








3. At Ellustrative ASW Contact Situation. 

The following hypothetical ASW contact situation witht he used as 2 
vehicle to discuss pertinent aspects of the decisiom problem. 

Suppose that an ASW Hunter-Killer Task Group is escorting « nerean- 
tile convoy during its mid-ocean transit. The convoy is following an 
established convoy route. [It is proceeding with a ten kmot speed-of- 
advance, The ASW group has the responsibility of providing ASW protec- 
tion for the convoy for a distance of 1,500 miles -- a six day transit 
period. 

The hunter-killer group is composed of an ASW aircraft carrier with 
a deck loading of fixed-wing search aircraft (S-2), and sonmar-dipping 
helicopters (SH-3). The carrier {s escorted by seven destroyers, 

The force is steaming in a typical disposition. Two $-2 search 
aircraft and four helicopters are maintained in a “ready” status on the 
carrier. 

An S-2 search aircraft reports a disappearing radar contact and 
investigates the area with "Julie". A "Julie'’ echo confirmation is 
obtained. Two S-2 aircraft and four helicopters are launched from the 
carrier to assist in prosecuting the contact. Two destroyers in the 
vicinity of the contact are also semt to the contact area. One helicos- 


ter gains sonar contact; another helicopter classifies the con 
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non-submarine. One of the alerted S-2 aircraft obtains a possible Julie 
fix; che other S-2 aircraft does not attempt Localization. Qne destroyer 
gains sonar contact; the other destroyer classifies the contact as mnon- 
submarine. 


Gne of the S$-2 aircraft drops 4 weapon on the contact based upon 


Or. 





Localization information. Weapon detonation 18 mst obserwed. Tw $-2 
dircraft, two helicopters and one destroyer refein in the contzet grea 
to conduct close search and localization until the area of comtact is 
well astern of the convoy. 

During the time interval required for the convoy to clear the ortgi- 
nal area of contact, relief aircraft and helicopters are Launched frora 
the carrier to replace those previously om statiom in the contact area, 
While this contact is being actively prosecuted three additional contact 
incidents are generated by other units of the AaswW force, 

This hypothetical contact situation provides a typicai seenario of 
actions and interactions of units within this ASW force. Imbedded 
within this contact situation are numerous tactical decision problems. 

The initial report of a disappearing radar comtact by the Search 
aircraft was the result of a specific decision, The plane commander of 
the search aircraft decided that sufficient information was awailable to 
classify a particular sensor indication as a possible submarine. 

The ASW group commander felt that the imitial indication plus the 
confirming Julie echo was sufficient justification for investigation by 
additional forces. The commander's estimate of the validity of the con- 
tact, combined with an appreciation of the current tactical situation, 
dictated the number and type of additional umits to be sent to the con- 
tact area. 

The decision to attack the contact with a weapon was based on the 
aircraft commander's (or the contact area commander's) estimate of the 
validity of the contact just prior to weapon release. 


% 


The decision to maintain forces in the contact area until the 
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convoy was clear of the area was a result of the ASW cuormander's esti- 
mate of the threat, weighted by a subjective probability measure thet 
the contact was in fact submarine. 

This is a somewhat abbraviated description of the step by step 
analysis that would take place in this typical situation. Some of the 
actions and decisions cited are probably a result of standard operating 
procedures and policies rather than specific decisions resulting from 
conscious analysis at discrete periods in the tactical sequence. For 
instance, general guidelines are usuaily promulgated to indicate what 
combinations of sensor response will make an attack profitable. 

Sonar has proven to be one of the best localization and classifice- 
tion equipments available. Development of the sonar-dipping helicopter 
provides the capability of putting sonar equipment into the contact area 
at an accelerated rate. The sonar equipment in 4 helicopter is gener- 
ally less effective than destroyer sonar, but the helicopter arrives at 
the contact area much sooner than the destroyer. This development tends 
to di’tate che types and numbers of units that the ASW commander will 
order .v & contact area after sufficient weight is givem to the degree 
of contact uncertainty and the current tactical situation. 

Every decision made during a contact incident is ultimately the 
responsibility of the ASW commander. Some decisions ara made by unit 
comnanders within certain limitations previously specified by the ASW 
commander. The decision to launch a weapon is generally included in 
this area. For completeness, these decisions might be termed pre-planned 
decision rules. Each of these decision problems might profitably be ana- 


lyzed and studied. 








The major decisions, the ones which effectively control the overall 
actions of the force, are made at discrete intervals by the ASW con- 
mander, These are the decisions of primary interest here. The main 
emphasis will be upon the commander's decision to prosecute fully a 
given contact, or to "drop" it. 

There is one aspect of this particular decision problem that appears 
unique. After a decision has been made to disregard a particular contact, 
it is often possible to hedge the decision. Im the illustrative situa- 
tion just cited, if the commander had decided to drop the contact, the 
decision might have been hedged by assigning, say, two aircraft to remain 


in the area until the initial contact location no longer posed a threat 


to the convoy. 





4. The Statistical Decision Process. 

An ASW commander faced with a contact decision problem has particu- 
lar information available to him. He is aware of the overall tactical 
situation. He has been apprised of the technical aspects of the ASW 
equipment within his force, and the local environmental conditions. 

The commander can solve the decision problem using an informal deci- 
sion method. On the basis of known facts, his experience, judgement and 
intuitive feel, he can decide to drop the contact, or supply additional 
forces to fully prosecute the contact. 

The other alternative is to systematically analyze each factor in 
the decision problem and apply relevant statistical decision rules to 
aid in the decision. 

Most aspects of these two decision methods are quite similar. The 
statistical decision process is but a formal method of considering facts, 
assumptions, and objectives that bear on decisions under uncertainty. 

The military reader will be aware of the step by step formalism in 
the commander's "Estimate of the Situation" set forth in the publication 
Joint Action Armed Forces. The major steps in the estimate are L) 
Mission and its analysis; 2) Situation and courses of actions 3) Amaly- 
sis of opposing courses of action; 4) Comparison of own courses of action; 
and 5) the Decision. 

Steps in the statistical decision process follow closely this mili- 
tary planning outline. The emphasis in the statistical decision method 
is on the concept of "expected value" associated with a given action, 

Lt will be well to discuss first the basic concepts of the decision 
y 


process in terms of a simplified example, using the probabilists® classic 


urn. 
19 


Consider an urn containing 85 white balls. A handful of 30 black 
balls is tossed at the mouth of the urn. You are then offered the fol- 
lowing proposition. An individual will reach into the wro and withdraw 
a single ball. Before the ball is withdrawn you are to guess whether 
the ball will be black or white. If you specify a black ball and a 
black ball is drawn you and the individual drawing the ball will win a 
total of $113; but if the ball is white you will both lose a total of 
$20. If you specify a white ball and a black ball is drawn your com- 
bined loss will be $255; but if the ball is white you gain a total of 
$45. 


This information is displayed in the following payoff table. 


ACTION 


| A, - Specify | A, - Specify 
white bali. | a black ball. 


Ep - Draw a 
black bail. 


EW - Draw a 
white ball. 





When the black balis were tossed at the mouth of the urn, you esti- 
mate that 15 of the black balls dropped into the urn. 

Your analysis of the situation might proceed in the following man- 
ner. From the information available and your observation of the toss of 
the handful of black balls, you feel that the urn now contains 100 bails; 
85 white and 15 black. This would translate into probabilities of 0.15 
for drawing a black ball and 0.85 for drawing a white bali. 

With an intuitive approach you might feel that your chances for 


gain would be better if you specified 4a white ball, (f.e., toox action 
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Ay). The "odds" appear to be in favor of a white ball heing drawn. 
Using the expected value approach, however, either section would be 
equally profitable. Putting the probabilities into the payoff table, 


we have: 


ae ee 



















Probability 
of the event 
occurring. 


ACTION | 
Ay = Specify ae Specify 
a white ball.| a black ball. 











E, - Draw a 
black bali. 








~ $255 


Ew - Draw a 
white ball. 


eee = 


The fact that the event EL, has a relatively high probability of 
occurring weighs heavily in its favor, But event F, , drawing a black 
ball, has some weight no matter how small. If the resuits of each 
action are weighed with respect to the proposed payoff and the proba- 
bility of occurrence for each event, a "weighted average payoff", or 
expected payoff can be determined. 

For action A, the expected payoff is: 


(0.15)(- $255) + (6.85)($45) = 5 00 


ot 


For action A, the expected payoff is; 


bk 
7 
) 
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CO.US)CSLL3S) + (O.85)C- $20) : 

Using the statistical decision approach, the decision rule for maxi- 
mizing gain (or minimizing loss) is to take the action having the higner 
expected return. In this example, either action could be specified with 
the same average return, zero dollars. 

This decision rule is relative. Wad the expected returns been 


equal to one cent and zero, deciding in favor of the action with a one 
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cent expected value would be somewhat marginal. The question is, how 
much "higher" should one's expected return be to justify deciding in its 
favor. This question must be considered within the context of tine par- 
ticular decision problem, 

As a further illustration, suppose the same game of chance is pro- 
posed. But in addition, the individual drawing the ball from the urn is 
offered an opportunity to conduct a series of experiments. He is allowed 
to draw a ball from the urn, note its color, and then replace it. The 
experiment to be conducted a maximum of 100 times. You are aiso told 
that there is a minute difference in the surface texture of the white 
and black balls. In all other respects, save the color and texture, the 
balls are identical. When the experiments are completed a color is to be 
specified and a single ball is to be drawn, as before. 

The payoff matrix will be the same as for the first example. The 
opportunity to conduct the experiments will cost $5, regardless of the 
outcome of the final gamble. This latter aspect is in accord with the 
somewhat realistic observation that information generally cormands a 
price. 

The individual drawing the balls from the urn is allowed to test 
the texture of one black and one white ball prior to conducting the pre- 
liminary sampling. 

Because of the higher payoff for specifying a black bali and then 
drawing a black ball, the individual drawing the ball would like to 
select a black ball from the urn on the payoff draw. During the sam- 
pling experiment he attempts to select a black ball each time. 


Suppose that in conducting the experiments 25 of tha 109 balls drawn 
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are black. That is, in attempting to draw a black ball &» testing the 
texture, the individual drawing the balls was sutcessiur 25 percent of 
the time, 

This problem is somewhat less amenable to am intultuve decision due 
to the added complications of the experiments and the cost of experi- 
menting. 

For the statistical decision process, uge is made of the following 


equation, due to Bayes, to weigh the information available. 


P(S|E,) 2(By) 


PCE, |S) a ee QQ) 
Se P(S|E,) P(E,) 
j 

where P(E ,1S) denotes the conditional or relative 


probability that event E, will occur, given the hypothesis that S$ is 
known to have occurred. 
An explicit form of equation (1), more pertinent to the example 


under discussion is: 
PCBS, = SET ET eR EE SES (2) 


In the example under discussion EF, and E,, are the events "draw a 
black ball" and “draw a white ball". The symbols S$. and 3, denoce the 
hypothesis that the individual drawing the ball “says” that he is draw- 
ing or attempting to draw a black or a white ball. 

P(E,) in equation (2) is the "a priori” probability of drawing a 
black ball. This is sometimes referred to as the actual or original 
probability. PCE,| $4) is the "a posterfori’ probabilitv ot drawing a 
black ball; often cailed the new or gained probability. The a posteriori 


probability is the new probability of drawing 2 bleck ball when the 


y f, 
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information on the capability of the individual to draw a black ball as 
considered. 

Using equation (Zz) to compute the compound probability of drawing a 
black balls 


plSp) = eee Oe) ee ete 
(0.25900. 15) + (0. 75)(0.85) 


Considering the original estimate of the number of black and white 
balls in the urn, and the information gained from conducting the experi- 
ments the probability of drawing a black bail is now 9.056. The proba- 
bility of drawing @ white ball, under these conditions, is one minus this 
amount, or 0.944, Putting these probabilities into the payoff table, we 


have 













PROBA-_ 
BILITY 


a 


to 


EVENT 








Expectec viliue: ~$17.55 


The individual payoffs reflect the five dollar information cost, 





Using the statistical decision rele to choose the action with the 
higher expected payoff, action 4, specify a white ball, is indicated, 

It should be noted that the individua'’s attewpt to draw a black 
bail produced a counter-effect on the decision. Even though he was 
attempting to draw a biack ball, the experiments indicated that there 
was a positive conditional probability of 0.75 Chat he would draw a 


white ball. To disregard this information, with the idea that the 
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individual was mot very adept in dtawing black wahis. wowld reduce th 
problem to the original exgaple hevine cquah eeverttd puyotfes. 

Tf after reviewing the results of the experigents, the ineividcuei 
had decided to try to draw a white ball om the final gabte, the histori- 
cal information gained from the experiments would be meaningless. Tine 


experimental conditions and the conditions under which the final draw 


would have been conducted would mot have heen the sane, 
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Had the experiments resulted im a sample of 65 black 
draws the expected payoffs would have bean ~- $55 for action A, amd $8.25 
for action A,. In this case action Ay, specify 4 black bail, would howe 
been indicated. 

These two examples have introduced two interpretations of proba- 
bilicy and the concept of expected value. 

Classically, probabilities have been interpreted im the relative 
frequency sense. For instance, the probability of observing “heads” on 
the toss of an average coin is 0.5. This means that if the coin is 
tossed cver and over again, the mumber cf heads observed will tend to 
equal the number of tails observed, Lt do@s not mean that if tha coin 
is tossed ten times that five heads will be obdserwed. 

Using a dacision rule favoring the higher expected value, im this 
sense of a "long-run average", would be valid only for events that are 
to be repeated over and over again. To use the long-rum average based 
on the relative frequency intérpretation of probability to specify the 
outcome of a single toss of the coin would have 2 meaning, 

Personal or subjective probabilities ara not xssertionrs of relative 


y = rf . . 1 ‘ , in . ‘ w a yy“ y ow 4 gry ih ay " 
frequencies, They are instead a maasurs of an individual's sunjective 


LS 








feeling as to the probable outcome of a particular ewesat, Subjective 
probabilities are often the same as relative frequency probabilities, as 
is generally the case for the toss of a@ coin. This is an indication 
that the only information available is the historical results gained 
from tossing average coins. But if additional infommation were avail- 
able regarding a particular coin, that it was bent, or that it was 
peculiarly weighted, then relative frequency would be only one factor 
to consider in specifying a personal probability for the toss of this 
particular coin. 

Using expected value as a guide to decision on the basis of personal 
probabilities is not dependent on the long-1uw1 average and the repetition 
of an event. It can logicaily be used as the basis for a single event 


decision. 
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>. The Statistical Decision Process Applied ro the ack Probles. 

The statistical decision concepts of the previous sections can be 
appized to the anti-submarine warfare contact situation. Pertinent 
factors in the hypothetical contact situation set forth im Section 3 
can be analyzed in a manner similar to that used im the ball and urn 
example. 

Somewhat realistically, it will be assumed that the ASW coumander 
has access to the following information: 

a. Kntelligence estimates indicate that from 7 to 15 of the enemy's 
fleet of submarines are probably assigned to the 1,500 mile segment of 
the convoy route under discussion. 

b. Records of previous exercises and convoy operations show that 
each airborne search unit will generate an average of 15 contact incident: 
for each 10,000 square miles searched. 

c. There is @ statistical measure of uncertainty for initial detec- 
tion and contact confirmation incidents that can be associated with each 
ASW vehicle/sensor type. The uncertainty measures are in the form of 
relative frequency probabilities obtained from reconstructed ASW exer- 
cises., 

Faced with a typical contact decision problem, the ASW cotwmunder 


must choose between two possible courses of action: 


y 


attack the contact, 


A, - "Drop the contact"; no further attempt is made to localize or 


- 


A. - "Prosecute the contact"; provide additional forces to attempt 
localization and kill. 


There are a large number of possible actions available to the ASW 


hw 
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commander, most of which are not relevant to the probdlem . 
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Although there are more than two feasible and relevant courtes of 
available, the present discussion will be limited te the two actioms 
Stated above, 


In terms of the previous discussion of the statistical decision 


of nature’, 

eae The contact is not a submarine. 

E, - The contact is a submarine. 

The third factor needed to construct the payoff matrix is the pay- 
offs themselves. Monetary payoffs of the kind used in the bali and urn 
example are not entirely meaningful here. The concept of utility or 
utility-value is broader and can include the monetary aspect. 

The ASW commander makes a value judgement as to the relative utility 
of taking a particular action under the assumption chat the contact is 
or is not a submarine. These value judgements are transformed into mu- 
merical values which are intended to ¢escribe the commander’s subjective 
ideas as to the relative value of specific outcomes. Inherent in this 
concept of utility-value is the commander's estimate of the consequences 
of disregarding a contact that is in fact a submarine, of prosecuting a 
contact that is not a submarine, etc. Thesé utility-walues are not con- 
Stant, they can and will change with changes in the tactical situation 
and the mission of the ASW force. 

For the hypothetical contact situation previously cited, the numbers 


representing an assumed set of such value judgements are Listed im the 


payoff table below. 









En ~ Contact is 
not a submarine. 











Ee =~ Contact is 


o> 


& submarine. 





The utility values in the payoff matrix are relative with respect 
to one another. The numbers could all be made positive by adding 250 to 
each one, and their relative ordering would remain unchanged. In addi- 
tion, such an adjustment would not affect the final indication in the 
statistical decision process. The use of positive and negative values 
is to provide a sense of physical gain or loss. 

The final factor to be considered is the degree of contact uncer- 
tainty. For this example suppose that the following relative frequency 


probabilities are available from reconstructed exercises. 


INITIAL DETECTION INCIDENTS 


—_— 


ITEM le /seasor “Walid | False Percent 
Detections | Detections Yalid 


=m 
Radar 48 20 
DD 
Sonar 9% 30 
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CONTACT CONFIRMATION INCIDENTS 


_| ~ Non- “Submarine 





Sane A, 









True State of Nature 














Vehicle/Sensor | )~—C<«rSWNom= [TY Non- 
Classification _ | Sub, as Sub. | Sub, | | 
80 50 
56 24 
60 LS 





The above data are hypothetical, developed for illustrative purposes 
only. The data are categorized by imitial detection and contact confirm- 
ation to provide for the two modes of crew operation. In a confirmation 
Situation the sensor operator, and in fact the entire crew, is in an 
"alerted condition, 

These statistics provide the conditional probabilities referred to 
in the urn problem. For instance, the helicopter sonar confirmation 
data provide the conditional probability P(HS,| Es), the probability 
that the helicopter sonar detection system will indicate "submarine" 
when @ submarine is actually present. The data give this particular 
probability as 0.40. 

Lf Bayes" rule is to be used a final statistic, not obtainable from 
the above data, is required. As im the urn problem, the @ priori or 
imitial probability must be known or approximated. Equate the initial 


number of black and white balls in the urn to the number of "submarines" 
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end “mon-submarines" am the particular ocean 4rea of interest, The re- 
quired probabilities are P(E), the ratio of the mumber of submarines 
presemt to the total number of submarines plus non-submarines present ; 
and P(E, ) > the ratio of the number of non-Submarines present to the sane 
total of submarines plus non-submerines. The non-submarines are the 
phenomenon and objects in the ocean that produce submarine-Like indica- 
tions im séarch sensors. 

Im the case of airborne systems, suppose that each aircraft gener- 
ates an average of 15 contact incidents for each 10,000 square miles of 
search, irrespective of the density of actual submarines. This can be 
used aS an approximation to the total mumber of submarine and nom-sub- 
marine contacts in each 10,000 square miles of search area, for each 

For this example, assuming a seatch area 50 miles on either side of 
the convoy track, search operations will cover 150,000 square miles. 
This translates into approximately 225 non-submarine and submarine con- 
tacts in the search area available to each search aireraft. 

The imtelligence information assumed in this example places 7 to 15 
enemy submarines im the same 150,000 square miles of ocean. Suppose 
that past exercise operations indicate that aircraft detection systems 
will detect 65 percent of the actual number of submarines in the exer- 
cise search area. Using this approximation and the maximum number of 
enemy submarines expected to be im the search area, the mumber of sub- 
marines in the total population of airborne contact incidents 1S approxi- 
mated at 9.7. 


rhuis lime of reasoning produces the following a priori probabilities 


it 
no 
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for aircraft search systems. 
P(E) = 0.043 P(E.) = 0.957 

The ASW commander is aware of the source and sample size of the 
Statistical information regarding initial detection and contact confirma- 
tion. In this example suppose that the majority of exercises from which 
these data were obtained were conducted in areas of "good" sonar condi- 
tions and sea states of 2 to 3. Current sonar conditions are "good" and 
the sea state is 0 io l. This information is used to modify the relative 
‘frequency probabilities provided by the data. 

For instance, the conditional probability for initial S-2/radar de- 
tection is indicated as P(Ss|E,) = 0.20. The commander assigns a sub- 
jective probability of 0.25 to this detection, based primarily on the 
current reduced sea state. The others are modified in a similar manner, 
where applicable. To summarize the relevant probabilities: 

The a priori probabilities: 


P(Submarine) = P(E.) = 0.043 


$ 
P(Non-submarine) = P(E,) = 0.957 
Initial detection probabilities; 
S-2 radar: P(SR,|Es) = 0.25 
P(SR,|E,) = 0.75 
Confirmation probabilities: 
S-2 Julie: PQSI_|E,) = 0-30 
(contact) 
Helicopter sonar; P(HS.|E.) = 0.40 
(contact) 


P(HS,|E,) = 0.30 


Helicopter sonar: FP(HS,|E,) = 0.60 
(no contact) 


on 

© 
~J 
© 


P(HS,| Ey) 
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Destroyer sonar: P(DS.| Es) = 0.60 


(contact) 
P(DSs| En) = 0.20 
Destroyer sonar: P(DS,| Es) = 0.40 
(no contact) 
P(DS,| E,) = 0.80 


The a posteriori probability to be determined in this example is 
the probability that the contact is a submarine given the conditions 
that the S-2 radar classified the contact as submarine; S~-2 Julie classi- 
fied it as a submarine; one helicopter classified it as a submarine; one 
helicopter classified the contact as non-submarine; one destroyer gained 
sonar contact; and one destroyer classified it as non-submarine. In 
symbols, the desired probability is P(&|0Ss DS, BSy HSs SJg SRg). 

If the initial detection and subsequent confirmations are consid- 
ered step by step, one action at a time, the a posteriori probability 
determined by one action becomes the a priori probability for the next 
action to be considered. 


For the initial radar detection, using Bayes’ formula, 


P(SRs/E,) P(E.) 


P(SR,|/E5) PCE) £ PCSRal 2) (en) 
The a posteriori probability that the contact is a submarine, using the 


information gained from the initial detection, is 


(0.25) (0.043) 


P(Es|SRs) = (9.25)(0.043) + (0.75)(0.957) = 07015 


Next, the information available from the S-2 Julie confirmation is 
considered. The a posteriori probability for the initial detection, 
P(E,|SR,), is used as the a priori probability, P(FE,),; , for the next 


calculation. 
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| P(SJglEs) P(Es)i 2 
P(SISIES) PCES) t+ PCSIg/EQ) PCEy), 


fh 


P(z, (SJ, 3R,) 


So that, 


P(E.]SJ. SR.) = —--——__(9-30)(0.015) |) 9 0075, 
Ca elenoka (0.30)(0.15) + (0.603(0.985) ~ ane: 


Continuing with each successive information factor, we have 
P(E,|HS, SJ, SR) = 0.0099, 
P(E,|HS, HS, SJ, SR,) = 0.0085, 
P(Es| DS, HS, HS, SJ, SR.) = 0.0043, 


P(E.) DS. DS. HSa0Ho eu. SR Onaler 


The final a posteriori probability that the contact is a submarine 
is 0.013. The probability that the contact is net a submarine is one 
minus this number, or 0.987. Putting these values into the payoff matrix 


and calculating the expected value, 













PROBA- ACTION 







EVENT 










BLLITY 
re fove | 
Te, | o.ors | 250 


Expected value 


The decision rule which favors the action with the higher expected 
payoff would indicate the selection of action A,, drop the contact. An 
additional criterion is provided when the expected values are considered 
within a relative frame of reference. 

Lf each of the vehicle/sensors had classified the contact as "sub- 


marine", the final a posteriori probabilities would have been 0.109 for 
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event E, and 0.89% for cvent E,: The expected values would have been 
-17.3 for action A, and “1.4 for action Ag. 

If each classification attempt had resulted in a "non-submarine 
classification, the probabilities would have been 0.005 for event E, and 
0.995 for event E,- The associated expected values for these probabili- 
ties are 48.5 for action A, and -14.5 for action A,. 

Intuitively, these two results appear to mark the extreme values 
that could be expected from this particular interaction. However, a 
wider range of values could occur. This situation is similar to the one 
discussed in the urn problem, where it was profitable to "bet against 
the individual selecting the ball." 

For the submarine contact situation,one limiting set of valucs would 
occur if the S-2/Julie sensor classified the contact as non-submarine and 
the other units classified it as a submarine, This would resuit in prob- 
abilities of 0.30 for event Es and 0./0 for event E.. The expected 
values would then be -40 for ection A, and 22.5 for action A,. 

The other limit would be defined for a S-2/Julie classification of 
submarine, with all other units classifying the contact as non-subnmarine. 
The probabilities would then be 0.0014 for evenc F, and 0.9986 for event 
En? with expected values of 49.6 for action A, and -49.6 for action A,. 

Comparison of the calculated expected values with the extreme values 
which could be anticipated can best be done by referring to the absolute 
differences in expected values. This difference in expected vaiues can 
be considered as a measure of "risk" when referred to the actioa with the 
lower expected vaiue. 


For the calculated values of 46.1 and -13.4 this absolute difference 
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is 59.5 when referred to action A,. In this case, to select action A, 
instead of A, the decision-maker is risking an amount 59.5. A zero risk 
value would occur when the expected values for each action were zero. 
The decision-maker would then be indifferent as to the choice of a par- 
ticular action. 


Calculating the risk values for the limiting conditions, we have 


99,2 Maximum value 


(63.0)+ (All vehicle/sensors classify contact as non-submarine) 


59.5 Actual classification information from vehicle/sensors 
0.0 Point of indifference 


(-15.9)+ (ALL vehicle/sensors classify contact as submarine) 


=62. > Minimum value 


2/ 





This method of comparing expected values provides a measure of 
relative magnitudes. It also permits comparisons with other contact 
incidents. 

Where physical considerations Limit the number of contacts that 
can be prosecuted simultaneously, a comparison of risk values will indi- 


cate the contacts which can be prosecuted most profitably. 
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6. Sensitivity Analysis. 

The a posteriori probabilities determined in the previous analysis 
were calculated to the third and sometimes the fourth significant figure. 
It will be said that it is unrealistic to generate numbers which infer 
four place accuracy when the input probabilities are subjectively deter- 
mined. But it can be argued that the input probabilities can be made as 
accurate as one desires them to be. If a probability of 0.90 is subjec- 
tively assigned for the occurrence of a particular event, an extension 
of this same type of subjective evaluation will permit one to opinionize 
a probability of 0.9032 with similar subjectivity. Probability in this 
sense is but ordered opinion, and the ordering can be as definitive as 
is required. 

In this particular application rounding-off probabilities to the 
first decimal place would fatally degrade the sensitivity of the indi- 
vidual classification inputs. There appears to be sufficient sensitivity 
in this type of analysis when input probabilities of two or three signif- 
icant figures are used. 

It will be noted that the sample size is quite small for initial 
contact and confirmation data. A data base of this size generally is 
not considered sufficient to provide statistical validity. This factor 
must be weighed by the decision-maker in making the final comparison of 
risk-values. A change in one of the recorded incidents creates a size- 
able change in the conditional probabilities. 

In the "submarine" incidents for DD sonar confirmation, the total 
sample size is 70 -- 42 correct classifications and 28 incorrect clas- 


sifications. These figures provide a probability P(DSs| Es) = 0.60. 
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A change in one incident, say cto 43 correct and 27 incorrect classifica- 
tions, would change this probability to 0.615. 

The hypothetical sample sizes used in this illustrative problem are 
intended to emphasize the relatively limited data base that is currently 
available. This shortcoming can be corrected. 

Sayes' theorem of conditional probability is far from being 4 new 
idea in statistics. However, opposition to its use has been widespread. 
This reluctance has stemmed from the difficulty of obtaining the required 
a priori probabilities. With the historic or relative frequency view of 
probability, the prior probabilities are required to be prohibitively 
accurate. [Introduction of subjective probability, the view that proba- 
bilities are a measure of one's personal opinion, has effectively removed 
this obstacle -- provided that this definition for the measurement of 
uncertainty is accepted. 

This is not to say that these probabilities are arbitrary. The a 
priori probability P(E,) is really a conditional probability. It is the 
probability of the contact being submarine, based on ali of the avail- 
able information about enemy submarines in the area, prior to the time 
the initial detection is made. 

A major advantage in using Bayes" theorem is that two logical bute 
different a priori probabilities will converge toward the same a poste- 
riori probability with successive applications of Bayes‘ formula. The 
a priori information becomes overwhelmed by the successive weighing of 
additional information. 

Suppose that the initial probabilities in the submarine example had 


been 90.29 for the contact being a submarine and 0.80 for the probability 
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af a non-submarine. These probabilities in the illustrative analysis 
were 0,043 and 0.957. With this set of different prior probabilities 
the final a posteriori probability would have been G.065 for the contact 
being a submarine. This would have produced a risk value of 37.8. The 
minimum and maximum risk then would have been ~-232.5 and 61.9. 
Experienced ASW commanders would not vary radically in determining 
the values for initial probabilities. In the highly unlikely circun- 
stance that the a priori probabilities were taken as 0.50 and 0.50, an 
extreme Limit would be reached. This would be the condition of equaliv 
likely occurrence. This situation is sometimes referred to as the condi- 
tion of equal distribution of ignorance, or the condition of insufficient 
reason. Equally likely events are those in which, after exhaustive ex- 


amination of the available information influencing the event, one is ied 
to assume that no particular event will occur in preference to the other. 
Tne following graph compares the two conditions just discussed and 


the resuits of the original analysis. 
cle ees 61.9 5 3ace 1.0 


37.8 0.9 
ms 


-3.0 
59.5 0.0 


0.0 


-62.5 “292.9 - 305.8 0.0 


on 








wine A is tha resulting risk-values for the original analysis with 
a priori probabilities of 0.053 and 0.957. fPprior probabilities of 0.20 
and 0.89 determined the results for BRB. The equally likely case is 
represented by C. The last line, D, is a scale for the intervals of 
risk-values involved. The numbers in boxes are those values determined 
by the initial detection and subsequent confirmations. The extrema 
vaiues for each case represent the maximom and minimum valuas that could 
have been obtained for the particular vehicle/sensers involved in the 
illustrative incident. 

it will be noted that the boxed value is in the upper one-fourth cf 
the risk interval in each case. As the prior probability for the sub- 
marine being present increases, the point of indifference, 0.0, moves 
toward the upper limit for the particular interval. This is as expected. 
The amount of movement is greater for small values of PCE.). 

The prior conditions for graph A assume that [5 submarines are in 
the area of search. For graph B this equates to an assumption of 112 
Submarines in the area. For graph C this number would be 285. 

A realistic view of the number of enemv Submarines that would be 
expected in a given search area will limit the @ priori probabilitics 
to those less than 0.20. This will tend to reduce the sensitiveness in 


the analysis created by large variations in the initiai probabilities, 
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/. Information Decisions. 

Im the previous analysis of the submarine contact incident it was 
assumed that the ASW commander was faced with a single contact decision 
problem at a specific point during the incident. This will not be the 
case in general. 

As the tactical situation progresses each contact gained by a sen- 
sor, and each period where contact is not made on the potential target, 
creates an interim decision point. In the illustrative situation the 
arrival of the helicopters in the contact area prior to the arrival of 
the destroyers, is an example of one such decision point. 

A decision analysis made at this point in the incident would have 
provided a risk-value of 61.4, with maximum and minimum values of 62.6 
and 45.9. The indication here would have been for a decision to drop 
the contact at this point. 

However, if no other contact incidents were in progress, or if it 
were possible to pursue this contact with a minimum loss of vehicle 
utilization, it might be profitable to delay an action decision until 
additional information were obtained. 

Yf£ additional incidents had been in progress at the time of the ini- 
tial contact referred to in the illustration, a comparative anaiysis of 
risk-values for each incident would have been in order. Such a compari- 
son provides a method of evaluating the cost of obtaining additional 
information for any one contact incident. 

This type of analysis permits the ASW commander to utilize his 


available forces most effectively. 
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8. Tacticak Use of the Bayesian Decision Process. 

The sea-going officer will view the foregoing analytical procedures 
with some trepidation. The mathematical methods are somewhat cumbersome 
and involved, or at best impractical for tactical use. 

Tt might be suggested that a computer program be developed for the 
shipboard Navy Tactical Data System which would accomplish the required 
mathematical manipulations and display the results. This would be in 
keeping with the command and control functions for which this type com- 
puter system was developed. However, the present meagerness of statis- 
tical data, coupled with the non-availability of NTDS type computers 
for ASW use, postpones a payoff for such a proposal to the distant 
future. 

A reiatively simple method which would accomplish the same task 
could be made available to ASW forces at the present time. The avail- 
able statistical data for initial datection and contact confirmation 
could be reduced to graphic form. This would provide a means for deter- 
mining the necessary contact probabilities. Elementary nomographs for 
computing expected values also could be made available. 

The graphs at the end of this section are examples of the type of 
graphs suggested. These samples were developed from the hypothetical 
data used in the previous submarine contact illustration. 

Figure L would be used for the initial contact. Figures 2 through 
7 would provide sequential probabilities as the interaction developed. 
Figures 8 through 1l are examples of nomographs for computing expected 
values. 


the probability graphs contain three curves. The solic line 
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represents statistical results for the exercise conditions stated in 
the chart. The broken lines, iabeled (+) and (-), provide a method of 
increasing or decreasing the solid-line probabilities by a factor of 
0.05. This permits the decision-maker to modify the historical data on 
the basis of current environmental conditions. 

The a posteriori probability obtained from one graph is used as 
the a priori probability for evaluating the information factor next in 
sequence. 

This type of graphical presentation, based on stored exercise sta- 
tistics, can be produced with the use of particular auxiliary equipments 


presently available at major computer installations. 
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